System, method and device-readable medium for communication event interaction within a unified event view

ABSTRACT

A method, electronic device, and device-readable medium are provided for implementing quick actions or additional actions in a unified inbox context. A number of communication event listings are displayed in either a first mode or a second mode. In the first mode, at least one user interface element for invoking a first operation is displayed for each communication event listing. In the second mode, at least one other user interface element for invoking a further operation is included in the communication event listing in addition to a user interface element for invoking the first operation. The user can selectively invoke the second mode from the first mode.

BACKGROUND

1. Technical Field

The present application relates generally to a system, method, anddevice-readable medium for event object interaction or management withina unified event view on a communication device display.

2. Description of the Related Art

Mobile communication devices, such as smartphones, tablets, and mobiledevices having hybrid form factors, are adapted for use with multiplemessaging services employing different formats and protocols. Acommunication device may be provisioned for multiple user accounts foreven a single message type. Typically, user access to messages ofdifferent types or accounts often requires use of a dedicated messagingapplication for each distinct type and/or account. Therefore, for easeof use, some communication devices are also configured to provideunified access to these different messages in a single view on thedevice display screen. Such a single view may take the form of a unifiedinbox, similar to an email inbox, which presents summary informationabout incoming (and optionally outbound) messages for the user'sreference.

As the volume of messages sent and received by users continues toincrease, so does the need for prompt and efficient management ofmessage data stores on the communication device. The inbox typicallyserves as the primary graphical user interface for managementoperations, but the limited amount of information that can be seen atonce onscreen is at odds with the increasing number of incomingmessages. In addition, with heavier reliance on touchscreen interfacesand gesture control of mobile devices, the graphical user interface onsome mobile platforms has become relatively “cueless”, relying on userrecollection of particular touch combinations or gestures in order toeffectively manage the inbox.

BRIEF DESCRIPTION OF THE DRAWINGS

In drawings which illustrate by way of example only embodiments of thepresent application,

FIG. 1 is a block diagram of an example electronic device for use withthe embodiments discussed herein.

FIG. 2 is a block diagram illustrating possible components of theelectronic device of FIG. 1 and interaction between the components.

FIG. 3 is an illustration of a unified event listing view displayable bythe electronic device in a first mode.

FIG. 4 is an illustration of the unified event listing view in a secondmode.

FIGS. 5A and 5B are further illustrations of the unified event listingview in the second mode executing a toggle action.

FIGS. 6A to 6D are further illustrations of the unified event listingview in the second mode executing a delete action.

FIG. 7A is a further illustration of the unified event listing view inthe second mode.

FIG. 7B is an illustration of an event listing view for a selectedmessage thread in the first mode.

FIG. 7C is an illustration of the event listing view of FIG. 7B in thesecond mode.

FIG. 8 is an illustration of a configuration view for configuringoperation of the second mode of the unified event listing view.

FIGS. 9A and 9B are illustrations of the unified event listing view inthe second mode with an overlay contextual menu.

FIG. 10 is an illustration of still a further unified event listing viewin the second mode.

FIG. 11 is a flowchart illustrating a method of operation for theelectronic device in the first and second modes.

FIG. 12 is an interaction diagram illustrating communication betweenselect components of the electronic device in implementing the secondmode of the unified event listing view.

FIGS. 13A to 13C are illustrations of the unified event listing view inthe second mode while carrying out an acknowledgement operation.

FIGS. 14A to 14I are illustrations of the unified event listing viewwhile performing a reply operation.

FIG. 15 is a flowchart illustrating a method of operation for theelectronic device in the unified event listing view while carrying out areply and other operations.

FIG. 16 is an interaction diagram illustrating communication betweenselect components of the electronic device in implementing the replyoperation of FIGS. 14A to 14I.

FIGS. 17A to 17H are illustrations of the unified event listing viewbefore and after display of a message view.

FIG. 18 is a flowchart illustrating a method of operation for theelectronic device when implementing the views of FIGS. 17A to 17H.

DETAILED DESCRIPTION

The embodiments described herein provide a method, electronic device,system, and non-transitory medium providing certain improvements in theoperation of a unified inbox or other message or communication eventlisting view.

There is provided a method implemented by an electronic device,comprising: displaying, on a display screen, a view comprising aplurality of communication event listings corresponding to a pluralityof communication events, the plurality of communication eventscomprising a plurality of communication event types or a plurality ofaccounts, the view being initially displayed in a first mode, eachdisplayed listing of the view in the first mode comprising a userinterface element for initiating a first action operating on itscorresponding communication event; in response to a command to invoke asecond mode for the view, displaying the view in the second mode, eachdisplayed listing of the view in the second mode comprising a userinterface element for initiating the first action and at least oneadditional user interface element for initiating an additional actionoperating on the corresponding communication event, different sets beingprovided for communication events of different communication event typesor different accounts.

In one aspect, the second mode user interface element for initiating thefirst action is a resized version of the first mode user interfaceelement.

In another aspect, the display screen comprises a touchscreen interface,and each of the first mode user interface element for initiating thefirst action, second mode user interface element for initiating thefirst action, and the at least one additional user interface element areeach actuatable to initiate their corresponding action by a touch.

In still another aspect, the view is generated by a unified eventapplication executing on the electronic device, and the method furthercomprises, while in the second mode: detecting actuation of one of theadditional user interface elements; and providing a request to adedicated application to execute the action on the communication eventcorresponding to the additional user interface element, the dedicatedapplication being associated with the communication event type oraccount of the communication event.

In yet another aspect, the view is generated by a unified eventapplication executing on the electronic device, and the method furthercomprises, while in the second mode: detecting actuation of one of theadditional user interface elements; storing data for initiating theaction associated with the actuated additional user interface element;and on detection of a trigger, providing a request to a dedicatedapplication to execute the action on the communication eventcorresponding to the additional user interface element, the dedicatedapplication being associated with the communication event type oraccount of the communication event, the trigger comprising either:actuation of another user interface element in the view; or a command toinvoke the first mode in place of the second mode.

In another aspect, each listing, in both the first mode and the secondmode, comprises an icon element, the icon element being included in thefirst mode user interface element but excluded from the second mode userinterface element; and in the second mode, the icon element is comprisedin a further user interface element for initiating a further actionoperating on the corresponding communication event. The further actionmay comprise a toggle between a read state and an unread state.

In yet a further aspect, the first action comprises a viewing operationfor the corresponding communication event.

There is also provided a non-transitory electronic device-readablemedium bearing code which, when executed by one or more processors of anelectronic device, causes the electronic device to implement theforegoing method and variants; and an electronic device, which may be ahandheld mobile communication device, configured to implement theforegoing method and variants.

The examples set out below are described and illustrated primarily inthe context of a handheld mobile device with a touchscreen interface.FIG. 1 is a block diagram of select components of an example electronicdevice 100 suitable for use with these examples. It will be understoodby those skilled in the art that the components illustrated in FIG. 1are merely representative of particular aspects of the electronic device100, and that other components that are typically included in such adevice have been excluded in the drawings and this description only forsuccinctness. Furthermore, those skilled in the art will understand thatthe device 100 may be successfully used with the various examplesdescribed herein even when some components described in relation to FIG.1 are omitted.

Operation of the electronic device 100 is generally controlled by a mainprocessor or processors 102. The device 100 may be a battery-powereddevice and would thus include a battery interface 103 connecting to oneor more rechargeable batteries 104. The batteries may be removable ornon-removable. The interface 103 can include an adaptor for receivingand converting mains power to power the device and/or charge or rechargethe battery 104. Data, programs, and other instructions or informationcan be stored in one of several possible memory components in the device100, such as flash memory 106, random access memory (RAM) 108, or otherstorage elements such as a memory card 110 received in an integratedmemory card port 109. Typically, software and data components such asthe operating system (OS) 140, programs (applications) 160, andapplication/user data 180 are stored in resident persistent memory suchas the flash memory 106, and some components of the OS 140 may beembedded as firmware in integrated memory in the processor 102. However,portions of such components may be temporarily loaded into a volatilestore such as the RAM 106, or on the memory card 110.

Communication functions, including data and optionally voicecommunications, are performed through one or more communicationsubsystems 116 a-n in communication with the processor 102. Otherfunctional components used to accomplish communication functions, suchas antennae, decoders, oscillators, digital signal processors, and thelike, may be considered to be part of these subsystems. Wirelesscommunication subsystems 116 a-n are used to exchange data with wirelessnetworks or other wireless devices in accordance with one or morewireless communications standards. New wireless standards are stillbeing defined, but it is believed that they will have similarities toany network or communication behavior described herein, and the examplesdescribed here are intended to be used with any suitable standards thatare developed in the future. The wireless link connecting thecommunication subsystems 116 a-n may operate over one or more differentradiofrequency (RF) channels according to defined protocols, such aswireless LAN (e.g., one or more of the 802.11™ family of standards),near-field communication, Bluetooth® and the like. The particular designof a communication subsystem is dependent on the communication networkwith which it is intended to operate.

The electronic device 100 is provided with at least a display outputinterface 113 that connects to a display screen 114, which is eitherintegrated into the device 100 (particularly if the device 100 isintended to be mobile or portable) or external to the device 100.Graphics data to be delivered to the display screen 114 via theinterface 113 is either processed by the main processor 102, oroptionally by a separate graphics processing unit (GPU) 112. In someexamples, such as those discussed below, the electronic device is atouchscreen-based device in which a combination display screen-touchinterface is a primary user interface mechanism, communicatinginformation and presenting graphical user interfaces to the user whilealso receiving user input that may be converted into instructions forexecution by the device 100. In such cases, the display screen 114 maycomprise a touchscreen digitizer layered on the actual display component(e.g. liquid crystal display) of the display screen 114, incommunication with a touchscreen controller 118 that processes detectedtouches and gestures on the touchscreen. The construction and operationof a suitable display screen and/or touchscreen interface will beunderstood by those skilled in the art. In some implementations, theelectronic device 100 is configured to output data to an externalmonitor or panel, tablet, television screen, projector, or virtualretinal display, via a data port or transmitter, such as a Bluetooth®transceiver, USB port, HDMI port, DVI port, and the like. Generally, asreferred to herein, “display”, “display screen”, and “display interface”are intended to encompass all implementations with integrated andexternal display screens unless expressly or implicitly statedotherwise.

The processor 102 also interacts with additional subsystems, if present.This can include I/O devices, sensors, and other components such as akeyboard 120, speaker(s) 122, microphone(s) 124, camera(s) 126, hapticsmodule 128 (e.g., a driver and a vibratory component, such as a motor),GPS or other location tracking module 130, other auxiliary I/O ports134, and other subsystems 136. Other I/O subsystems can include pointingdevices or touch devices such as trackballs, IR fingerprint detectors,roller wheels, optical joysticks, and trackpads. The electronic device100 may also be provided with an orientation or inertial navigationsensor 132 such as one or more accelerometers, used to detect theorientation of the device 100. Not all of these subsystems are required,and many may be omitted. For instance, where the primary user interfaceis a touchscreen, a physical keyboard may be omitted altogether. Somesubsystems may be provided instead as peripheral devices that connect tothe device 100 using a data port or transmitter.

FIG. 1 also illustrates software modules, including the OS 140 andprograms 160 that may be present on the device. Not all of the modulesillustrated need be provided on the device, and other softwarecomponents may certainly be provided on the device instead. Programs 160may be installed on the device 100 during its manufacture or togetherwith the loading of the OS 140, or at a subsequent time once the device100 is delivered to the user. The OS 140 and programs 160 may be loadedonto the device 100 through at least one of the communication subsystems116 a-n, an I/O port, or any other suitable subsystem.

Specific examples of applications that may be resident on the electronicdevice 100 include an email messaging application 161, as well as othertypes of messaging applications for instant messaging (IM) 162, ShortMessage Service (SMS) 163, and social networking or messagingapplications 164. Other applications for messaging can be included aswell, and multiple applications for each type of message format may beloaded onto the device 100. There may be, for example, multiple emailmessaging applications 161, and multiple IM applications 162, eachassociated with a different user account or messaging service.Alternatively, other means may be implemented on the device 100 toprovide access to multiple messaging accounts or message types; forexample, a unified inbox application 167 may be provided on the deviceas an application or as part of the OS. The unified inbox application isconfigured to list messages received at and/or sent from the device 100,regardless of message format or messaging account.

Other applications include a calendar application 165, task application166, map or navigation application 168, utilities 169, media player 170including audio 171, photo 172, and video 173 components for playback,recording, and/or editing of media files, contacts or address bookapplication 174, browser 176, file manager 177. Other applications 178may be included. Again, not all of these applications need be providedon the device 100. One or more virtual machines 175 may also be residenton the device 100, possibly integrated with the OS 140, to providediscrete runtime environments for executing code on the device 100.

The memory of the device 100 also houses the application data 180, whichcan include configuration information, and data stores for user data.Permission to access the data store for a given application may belimited to the associated application, although permissions may beconfigured differently so that other applications or functions executingon the device have access to data objects stored in the data stores, orat least have access to metadata for these objections.

While the example electronic device 100 is a wireless communicationdevice and may be referred to herein as a “handheld” or “mobile” device,it will be appreciated by those skilled in the art that this descriptionis not intended to limit the scope of the described embodiments toimplementation on devices with a specific form factor or devices thatare intended primarily or solely for communication or productivity. Theexamples herein may be applied to any appropriate data processing deviceadapted to communicate over a fixed or wireless connection, whether ornot the device is portable or wirelessly enabled, whether or notprovided with voice communication capabilities, and regardless of itsprimary intended usage, such as productivity or entertainment. Suitabledevices may therefore include, without limitation, cellular phones,smartphones, wireless organizers, personal digital assistants, desktopcomputers, notebook computers, laptops, tablets, terminals, gamingdevices, and the like. Unless expressly stated, an electronic device 100may include any such device. The configuration and operation of all suchdevices is generally known to those skilled in the art.

The electronic device 100 may be provisioned with single or multiplemessaging accounts employing one or more different messaging formats ortypes, which can include email, Short Message Service (SMS), InstantMessaging (IM), Multimedia Messaging Service (MMS), Visual Voicemail(VVM), PIN-based messages (messages addressed using an alternateidentifier, such as a proprietary address or hardware identifier),social network messages or notifications, and calendar and task events(if not transmitted as attachments to other messages).

The formatting and transmission of all such messages, storage andindexing of such messages, and the implantation of suitable messaginginfrastructures to support all of these example communications will alsobe known to those in the art. For example, email messages and servicesmay be constructed and implemented in accordance with known Internetmessaging standards including Internet Message Format RFC 5322 and RFC2822, published by the Internet Engineering Task Force, as well as theirpredecessor, successor, and companion standards. IM messages includenetwork-based and peer-to-peer messages, and such messages and servicesmay be defined in accordance with known standards such as RFC 2779 andRFC 3921 also published by the Internet Engineering Task Force, andtheir companion, predecessor and successor standards. Point-to-point SMSmessages may be implemented in accordance with 3GPP (3^(rd) GenerationPartnership Product) Technical Specification 03.40, and optionallyextended for transmission of MMS messages as specified by the OpenMobile Alliance Multimedia Messaging Service V1.3, and their companion,predecessor and successor standards. Regardless, all such messages andservices intended for use with the within embodiments may also bedefined in accordance with proprietary standards and protocols. Messagesmay be defined, formatted, and presented using messaging applicationsimplemented on user devices such as the electronic device 100 describedabove. Messages are typically identifiable by a unique or quasi-uniquehandle or identifier (ID), implemented within the message format in asuitable location, for example in a header of the message. Some messageformats may not include a header distinct from the body in the manner ofan email format, but may nevertheless comprise content in a payloadportion in addition to metadata. Some message types permit messages tobe interrelated, for example by cross-referencing identifiers, threadidentifiers, subject line, or the like, as discussed below. Whetherinterrelated or not, messages exchanged between a given set ofparticipants (senders and recipients, or originating and recipient ordestination devices) may be presented by messaging applications in aconversational paradigm, chronological order, or reverse chronologicalorder, or in any other suitable presentation form or order.

In addition, the electronic device 100 may also be configured togenerate notifications to the user (e.g., by visual or audible means)about various status changes or events detected by the device OS 140 ora particular application 160 executing on the device, such as anotification of a telephone call event (e.g., an incoming call, whetheraccepted or missed/ignored, or an outgoing call); an application or OSupdate available for download; device status notifications such aslocation-based alerts; notifications triggered by a specific devicestatus such as low battery level, low storage capacity, and so forth.These notifications are optionally configurable by the user. The formatof the notification may be proprietary to the platform on which theapplication operates, or proprietary to the application or the OSitself, but it is expected that a notification will likely include anidentifier such as a handle for the application or function that spawnsthe notification, and a content or payload portion comprising theinformation to be conveyed to the user, and optionally ancillarymetadata.

Messages and notifications may be considered to be “communicationevents”, as they are intended for presentation to the user of theelectronic device 100, whether or not the originator of thecommunication event is another user, a network operator, or theelectronic device 100 itself, whether or not the communication event isreceived by the electronic device 100 over a network, and regardless offormat or protocol employed. As used herein, “communication event” isnot necessarily restricted to the fact of an occurrence, but may also beused interchangeably with “communication event data”, “item” or“object”, to reflect the data received or otherwise obtained by theelectronic device comprising content and/or metadata pertaining to theevent.

As mentioned above, unified user access to a plurality of message typesand/or accounts may be provided on the electronic device 100 by means ofa unified inbox which collects information about messages associatedwith different types and/or user accounts, and presents the informationin a global message or content list for viewing or interaction by theuser. The unified inbox, however, need not be restricted to messages; itmay include all types of communication events, including notifications.The unified inbox listing may therefore be considered to be a unifiedlisting of “events” rather than merely messages, and unless expressly orimplicitly stated otherwise, references herein to a “unified inbox”,“unified event list(ing)”, or “unified communication event list(ing)”,or to a set of communication event listings, are intended to beinclusive of messages, notifications, and analogous data objects such asdraft messages. The description below also refers to a “unified eventmanager”, which is configured to generate and present such a unifiedinbox and may be the application 167 or that set of processes within thedevice OS 140 that permits single-view access to communication eventsassociated with a plurality of applications, message formats or types,and/or accounts in the manner described herein.

FIG. 2 is a block diagram illustrating select components on theelectronic device 100 pertaining to the management of communicationevent data. Data accessible to the electronic device 100 is provided ina number of data stores 210, which may be maintained in memory residentin the electronic device 100 itself, and typically in persistent memory.As can be seen in FIG. 2, the data stores 210 include stores for eachtype of message or notification serviced on the electronic device 100;thus, there may be one or more of an email store 211, IM store 212, SMSstore 213, PIN store 214, MMS store 215, and other stores 216. Thestores 210 may be associated with a dedicated messaging or notificationapplication or function executing on the device, and/or with aparticular message format. Since a device 100 may be provisioned withmultiple user accounts for similar message formats, each provisionedaccount may be allocated its own distinct data store; therefore, theremay be multiple email data stores 211, multiple IM stores 212, and soon.

The messaging data stores 210 maintained at the device 100 may representonly a portion of the complete message data associated with a givenformat or account. Complete data stores may be maintained at a remotelocation, such as s message server system available over a wirelessnetwork connection. Other communication events, such as notifications,may be stored in one of the distinct data stores on the device, althoughin some examples the notification may not be stored in a dedicatedapplication data store; instead, the application may directly providethe notification data to the unified event manager 260, as discussedbelow.

Typically, each data store 210 is under the control of and is accessedby a corresponding or dedicated application 220. FIG. 2 illustrates thatthere is an application 220 corresponding to each of the data stores210; thus, there are one or more email applications 221, IM applications222; SMS applications 223, PIN applications 224, MMS applications 225,and other applications 226. When a new object or transmission comprisingcommunication event is obtained by the electronic device 100 or a changeto an existing communication event is detected, the appropriateapplication 220 is notified, if the application 220 itself was not thesource of the new or changed communication event. The application 220can then store the new or changed communication event in itscorresponding data store 210.

Communication events within a given data store may be arranged orcategorized in virtual “folders” or “files”, or otherwise given categorytags or similar attributes for assisting the user in organizingmessages. Possible folders or categories for the email store 211 areillustrated in FIG. 2. In this example, the email store 211 includesvirtual folders for a default inbox folder 211 a, to which new incomingmessages are automatically allocated in the absence of any ruleassigning the message to another folder; an outbox 211 b, to whichmessages to be transmitted from the electronic device 100 are allocated;a sent items folder 211 c, to which those messages successfully sentfrom the device 100 are allocated; a deleted items folder 211 d; a junkmessage folder 211 e; and any user-defined folders 211 f-n. When amessage is processed by the associated messaging application, theapplication may set a flag or an attribute for the message designating afolder, (which may be in the message's header, or else otherwiseassociated with the message) and store this flag or attribute inassociation with the message in the data store 210. The application usedto access the data store can use the flags or attributes to sort ororganize the messages for presentation to the user. Other types ofcommunication events besides email may be capable of being organized orcategorized in this manner as well.

A new communication event may be “obtained” in that it is generated bythe application executing on the device 100, which may be the case wherea message is being composed on the electronic device 100 and stored inthe appropriate data store 210. It may also be obtained through receiptover a fixed or wireless connection, as in the example of a messageaddressed to the user of the electronic device 100 and received by thedevice, or in the example of a communication event that is received bythe device 100 through synchronization of a data store 210 with a serveror other data source over a fixed or wireless connection.

A change to a communication event that was previously stored in a datastore 210 may result from the user editing or altering the communicationevent (as in the case of previously-stored draft message that issubsequently accessed and edited by the user); from synchronization whena newer version of a communication event is merged with, or overwrites,a corresponding communication event already stored in a data store 210;or from a change to the communication event's status or attributes(e.g., metadata). For example, when a communication event such as amessage is received at the electronic device 100, it may beautomatically assigned a status or flag indicating that it is “new”, or“unread”, or “unopened”; but once the communication event has beenaccessed by the user (e.g. viewed on the display 114), the status of themessage may be altered to remove the “new” designation”, and/or tochange the “unread” or “unopened” status to “read” or “opened”. Anapplication 220 may be configured to automatically make such a change tothe message status once the message is read, but status values andattributes of a communication event may also be altered expressly by theuser, rather than automatically. For example, the user may choose tomark a “read” message as “unread” again, or to delete the message fromthe data store. There are a number of different status identifiers orattributes that are conventionally assigned to messages, such as “read”,“new”, “draft”, “recent”, transmitting” or “pending”, “deleted”,“filed”, and so forth. The meanings of such attributes or statusidentifiers, and their application, will be understood by those skilledin the art, and furthermore those skilled in the art will understandthat these attributes and other terminology pertaining to status orattributes herein are not intended to be limited to a single literalmeaning, and some terminology will be understood by those skilled in theart to be synonymous with other terminology.

The various data stores 210 thus comprise a set of communication eventdata sources that can be directly accessed by their respective custodianapplication 220, and processed in diverse ways for customizedpresentation by the application 220. In addition, the electronic device100 of FIG. 2 includes a unified event manager 260 that provides for theunified presentation of diverse communication events, as mentionedabove. In response to a new or changed communication event, anapplication 220 notifies other components, such as the unified eventmanager 260, or another process such as a home screen application (notshown in FIG. 2) executing on the electronic device 100. Thisnotification is to be distinguished from the user-directed applicationand device event notifications described above. The notification toother components may comprise data passing directly from the custodianapplication 220 to the other components each time a change is made tothe data store 210. Alternatively, each application 220 may grant accessto other components on the device 100 to monitor notifications issued bythe application. Each component having an “interest” in changes made toa given data store 210 may register as a listener for new notificationsby the application 220. Notifications may include a communication eventidentifier (ID) or handle, a value unique to at least the application220 to uniquely identify the communication event in the data store 210;an application ID to identify the custodian application; and optionallyinformation about the status change (e.g. “new”) or other metadata, oreven select content of the communication event. If listening componentsreceive only the identifiers in a notification but still requiremetadata or message content, the listening components may be granteddirect access to the application data store 210 to retrieve the requiredinformation.

In this particular illustrated example, for convenience a merged index230 of communication events is defined and stored on the device. Thismerged index 230 can comprise a master index of communication events,which obtains information about changes to the data stores 210 fromvarious applications 220. The merged index 230 provides informationabout indexed communication events to a conversation or threadingmanager 240, if available on the electronic device 100, and/or to theunified event manager 260. The unified event manager 260 may use themerged index data 230 to construct unified inbox views for display. Theconversation manager 240, if present, generates a threaded index ofcommunication events based on the information in the merged index 230,and determines membership of a given communication event in a threadbased on select attributes of the communication event. Information aboutthreads may be provided to the unified event manager 260 in the eventthat communication events are to be presented in the unified event viewcollated by conversation or thread. Different methods of defining amessage thread or conversation, and determining whether a given messagebelongs to a particular thread or conversation, are known to thoseskilled in the art.

The merged index 230 and/or conversation manager 240 may be comprisedwithin the unified event manager 260, or may be independently runningprocesses that serve other applications on the device 100. Accordingly,the description below refers generally only to the unified event manager260 for ease of reference. Examples of unified inbox operation,conversation manager operation, the use of merged indexes, and otherfunctions that operate in conjunction with a unified inbox are describedin U.S. Pat. No. 7,568,011 issued Jul. 28, 2009; U.S. Pat. No. 8,375,400issued Feb. 12, 2013; and U.S. Patent Application Publication No.2013/0297604 published Nov. 7, 2013, all of which are incorporatedherein by reference.

During execution, the unified event manager 260 or another application220 may require services from or user interaction with anotherapplication executing on the device. For instance, when a user wishes toview a given message in a unified inbox view displayed by the unifiedevent manager 260, the actual display of the message may be managed bythe custodian application 220 that owns the data store in which themessage is stored, or that is associated with the message type ofinterest. Thus, in response to a user command to display the messagecontent, the unified event manager 260 may send a request to themessaging application to launch a particular view displaying the messagecontent. The requests may be sent directly from one application orprocess to another; however, it is often convenient for such requests tobe brokered by an invocation manager 250, which receives invocationrequests from requesting applications or processes, and sends therequests for service to the designated target. In this way, bothrequesting and responding applications need only address the invocationmanager 250 rather than track the addresses or handles for potentiallydozens or hundreds of different applications and processes available onthe device. FIG. 2 thus includes an invocation manager 250, incommunication with the unified event manager 260 and other applications220.

Turning now to FIG. 3, an example of a first unified communication eventview 300 containing a listing of a number of communication events as maybe generated by the unified event manager 260 is shown. It may be notedthat the display screens of devices illustrated herein generally includea status bar or banner 310, which conventionally includes device statusinformation of particular relevance to the user, such as the currentdate/time, battery level, signal level, and network identifier. Thestatus bar 310 can omit some of this information and include otherinformation. The status bar 310 is typically a fixture on all or mostapplication views on a typical device, and is not necessarily generatedor managed by an executing application on the device, but rather by theOS 140; accordingly, it may be considered to be excluded from theunified communication event views discussed below.

In the first view 300, it can be seen that there is a set ofcommunication event listings 330 arranged in a list format. The examplesdescribed herein are described and illustrated primarily in relation toemail, Short Message Service (SMS), and Instant Messaging (IM) messages.However, in view of the discussion above, it will be appreciated bythose skilled in the art that these examples can be extended to othertypes and formats of communication events, including without limitationthose other types and formats mentioned above. It can be seen from FIG.3 that each communication event listing within the list contains someinformation about the communication event, such as a sender name,subject line (if applicable), preview (excerpt) of the message (ifapplicable), a date and/or time of receipt, and any other indicators orflags to indicate particular attributes of the message, such as whetherthe message has been flagged or contains an attachment.

The first view 300 also includes an optional overlay 350, which includesicons or user interface elements for invoking frequently accessedcommands, such as “compose a new message” 353, “view attachments” 352,and “search” 354. Other user interface elements 351, 355 may be includedto permit the user to access other communication event information oradditional functions. This overlay 350 is omitted from the remainingdrawings for clarity.

In the first view 300, each listed communication event is represented bya principal user interface element 340 (indicated by a dashed line)that, when actuated, permits the user to access an operation on thecommunication event, or further information about the communicationevent. For example, to view the message content of the communicationevent represented by the principal user interface element 340, on atouchscreen-based device 100 the user may touch the surface of thescreen coinciding with the principal user interface element 340 toinvoke a view message operation for the communication event; or, inresponse to a “long press” (a touch having a duration extending beyond apredefined threshold time), a context menu containing further userinterface elements for invoking further commands may be displayed. Thus,“actuation” of a user interface element can include conventional userinput operating on the user interface element so as to provide a signalor instruction to the executing application or OS that a particularaction represented by the user interface element is to be carried out. Auser interface element is “actuatable” if a command, action, oroperation associated with the user interface element can be invoked as aresult of a user input selecting or otherwise acting on the userinterface element. Different forms of actuation (by a touch or gesture,or by a pointing device, voice command, and the like) will be known tothose skilled in the art.

The principal user interface element 340 can include graphic and textualelements as in the example of FIG. 3. Here, the principal user interfaceelement 340 includes an icon 342 that indicates a particular status orattribute of the communication event, as well as the communicationevent's type, and summary content and/or metadata 344 such as thesender, subject line, and datestamp. Not all of the information depictedin FIG. 3 need be included in the principal user interface element 340,and the user interface element 340 may include other information.

The unified communication event listing view 300 of FIG. 3 isrepresentative of common event listing views currently employed onmobile devices, and illustrates some of the difficulties in implementinga robust user interface for management of multiple data items on a smalldisplay screen. The event listing view generally employed on handheldmobile devices is based on the usual type of message listing view usedwith desktop and laptop computers, which have larger screens; but on asmaller screen, there is limited space available for icons and othergraphical user interface elements that can be associated with actions oroperations to be performed on individual communication events, such as“reply” or “forward” actions. Adding these icons comes at a cost ofdisplay space available for other useful information about the listedcommunication events. Instead, mobile device messaging applications andinbox applications rely on nested or multiple-stage commands: to replyto a message, the user must first view the message, and then locate a“reply” button on the message view screen; or else, the user must invokea context menu specific to the selected message in order to view a menuof options for replying to or forwarding the message.

Increased reliance on messaging of all forms, and the continued creationof new messaging services and social network platforms, result in evenmore messages and notifiable events arriving at a user's mobile device.The unified communication event listing provides a convenient way forthe user to review multiple types of messages at a glance instead ofserially launching and operating multiple messaging applications. Again,though, the smaller screen size of mobile devices restricts the numberof messages and notifications viewable in a single glance. A heavy userof messaging services will likely find it necessary to scroll pastscreenfulls of newly received messages in order to find messages thatwere received even only a few days ago.

Bulk management is sometimes a useful way to deal with the onslaught ofincoming communication events. For example, a user could review a set ofmessages, determine that they do not need to be retained in the messagedata store, and delete the entire set by selecting a plurality ofmessages, then invoking a “delete” command. Or, the user might choose tofile all of the messages, thereby removing them from the unified view,if the device 100 is configured to exclude filed messages from theunified view. In a typical touchscreen device scenario, bulk processingof n messages therefore requires n+2 touches: one to enter amultiple-select mode; one for each message selected; and one for theinvoking the delete command. If the touchscreen device supportsmulti-touch, the bulk processing may require only a multi-touch gestureto select a plurality of messages plus one gesture for the deletecommand. Bulk management, however, requires that all selected messagesbe processed the same way. If the user wishes to delete one message andfile the next, then a minimum of two touches for each message isgenerally required in a touchscreen environment: one to select themessage of interest, and one (or more) to select the desired action.Thus, individual processing of n messages may require at least 2ntouches, which requires more processing resources to handle, andinvolves more wear on the touchscreen than the bulk management option.

Accordingly, in these example embodiments, the unified event manager 260on the electronic device 100 is configured to selectively operate theunified communication event listing view in two modes. The first mode isreflected in the view 300 of FIG. 3. The second mode is illustrated asview 400 in FIG. 4. The unified communication event listing view may betoggled between the two modes by actuation of a user interface element420, located in any appropriate position on the display screen, oralternatively by a predefined gesture command, keypress combination,voice command, or other user input.

In the second mode, a region of the view 400 now displays an array offurther user interface elements 450, with one or more additional actionuser interface elements 450 corresponding to each communication eventlisting in the unified view. Each of these user interface elements inthe array 450 is associated with, and may be actuated to invoke, anaction that operates on its corresponding communication event. Thespecific actions that are associated with the correspondingcommunication event depend on either the communication event type, thedevice user's account associated with the communication event, or both.For instance, in FIG. 4 it can be seen that while the majority ofcommunication event listings now include a “delete” action userinterface element, as exemplified by a trashcan icon 448, not everylisting includes this user interface element. Table 1 illustrates apossible assignment of actions to communication events of differenttypes, where a maximum of two actions is assigned:

TABLE 1 Example assignment of actions according to communication eventtype. Type Action 1 Action 2 Email message thread Flag Delete Singleemail Flag Delete Draft message (any File (or Edit, or Delete type)None) Meeting invitation Accept Decline Device event (e.g. None Deletedevice status) SMS message Reply Delete (end chat) IM message ReplyDelete (end chat) PIN message None Delete Social message Share (or None)Delete Phone event (e.g. Send reply SMS (or Delete missed call) None)Other (default) None Delete

Thus, in the example of Table 1, those types of communication eventsthat have formats supporting the setting of a “flag” attribute (e.g., afollow-up flag, as opposed to a priority attribute set by the originalsender of the message) may be associated with a user interface elementfor an action to invoke a flag action. Most communication event typesare associated with a “delete” action, but in the case of a meetinginvitation, the actions provided in the array 450 are “accept” and“decline”. Some communication event types are associated with a form ofreply (or “sharing”, in the case of certain types of social networkingmessages) that can be composed while remaining in the context of theunified communication event view; these reply operations are discussedbelow, as are meeting invitations. The assignments in Table 1 are merelyexamples; variations are certainly possible and within the scope of theperson of skill in the art. For instance, one of the actions may beconfigured as an operation to send the corresponding communication eventto a “junk” folder in the event the user determines that it isunsolicited mail.

The assignment of actions to particular communication event types oraccounts may be carried out at the time the custodian application 220associated with a given communication event data store 210 is installedand registered with the unified event manager 260. In the absence of anydefinition of actions to be associated to a particular communicationevent type, a default set of actions consisting of a “delete” userinterface element may be assigned. The assignment of actions will bediscussed in further detail below.

When one of the action user interface elements included in the array 450is actuated, its corresponding operation is carried out on thecorresponding communication event. The operation may follow immediatelyupon actuation, but in some instances, the user may be given anopportunity to undo or prevent the operation from being carried out.This may be done in the case of deleting a communication event, ormoving it to another location or folder, which on a mobile device may bean act of relative permanence with respect to the unified communicationevent view, since deleted items may not be retrievable on the mobiledevice or via the unified view. In that case, the operation is notactually committed until a triggering event is detected. As will be seenin the following discussion, the action user interface elements includedin the array 450 may also change depending on the state of thecommunication event in the unified communication event view 400.

As can be seen in FIG. 4, the number of “active” regions (i.e.,actuatable user interface elements) for each communication event listinghas increased from the single actuatable user interface element 340 inFIG. 3. In the example of FIG. 4, there are now up to four actuatableuser interface elements: the first user interface element 442 comprisesan icon, and may be used to toggle a “read”/“unread” attribute of acommunication event, where applicable (not all communication event typessupport this type of attribute); principal user interface element 444,which in this example includes communication event content and/ormetadata as in the summary content/metadata 344 of FIG. 3, is actuatableto invoke a viewing operation (i.e., to view the communication eventdetails in a new view that replaces the unified communication eventlisting onscreen); third user interface element 446 comprises an iconand is associated with the first additional action; and fourth userinterface element 448 comprises an icon and is associated with thesecond additional action. The user interface elements need not containthe specific illustrated icons shown in FIG. 4, or make use of icons atall. While the summary content and/or metadata that were visible in FIG.3 are now truncated in the illustration of FIG. 4, it should be recalledthat this truncation is only temporary, because the unified eventcommunication listing view 400 is being displayed in the second mode.

This second mode permits the user to invoke a plurality of actions inrespect of a plurality of communication events, even if the actions aredifferent, while reducing the amount of time the user must spendnavigating the unified communication event view 400, and also possiblyreducing the number of user input events (e.g., touches), or theduration of user input events, required to effect all of these actions.

FIGS. 5A and 5B illustrate how some action user interface elementsrespond to actuation to permit the user toggle their effects. The view500 a in FIG. 5A illustrates the effect of a touch or other actuation onan icon. In FIG. 5A, actuation of the user interface element 442′(demarcated by an ellipse representing a possible area of a touch, if atouch input is employed) results in the message thread represented bythis communication event listing being marked as “unread”, as it waspreviously marked read (as signified by the state of the icon in 442 inFIG. 4). Actuation of user interface element 502, previously signifyingan “unread” state, marks the communication event associated with theuser interface element 502 as “read”. Actuation of these communicationevent icons thus toggles the communication event between a “read” and“unread” state, and optionally toggles the visual appearance iconbetween different states in order to signify to the user that a changein an attribute was made. When the state or attribute associated withthe communication event is changed, the changed value is stored inassociation with the communication event in its corresponding data store210.

The availability of a “read”/“unread” action by actuation of thisparticular user interface element depends on whether the communicationevent type supports a “read”/“unread” state. For instance, theapplication or OS function that issues device status notifications(e.g., a warning about low storage capacity remaining) may not store thenotifications in a manner that permits them to be marked as read orunread. In that case, this toggling user interface element may not beprovided for this type of communication event; instead, this region oricon in the communication event listing may be combined with the mainactuatable user interface element for the communication event. Referringback to FIG. 4, where no read/unread toggle action is available for acommunication event, the user interface element 442 may be incorporatedinto the main user interface element 444. In the illustrated examples,the unified view may include visual indicators demarcating the varioususer interface elements so as to indicate to the user that each userinterface element represents a distinct action. For example, it can beseen that the different user interface elements in communication eventlisting 440 are visually separated not only by space, but also by avertical line segment.

View 500 b of FIG. 5B illustrates a further toggle effect on one of theactions specified for the email message thread event type. In FIG. 4,the icon of user interface element 446 was in a first state, indicatingthat the message had been “flagged” (e.g., for follow-up). In FIG. 5B,as the result of a touch or other form of actuation, the icon in userinterface element 446′ has been “cleared”, or removed.

FIGS. 6A to 6D illustrate the operation of the unified communicationevent view 600 a-600 d in response to a “delete” action. A “delete”action, in this implementation, is not actually committed until atrigger event is detected, to provide the user with an opportunity toabort the deletion. FIG. 6A resembles FIG. 4; in this unified eventcommunication view 600 a, the user interface elements 612, 614, 616, and618 which appear in relation to communication event listing 610 areindicated. These user interface elements correspond to the exampleelements 442, 444, 446, and 448 described in relation to FIG. 4. Userinterface element 612 is an icon that can be actuated toggle a status ofthe single message represented in this listing 610 between “read” and“unread”; user interface element 614 contains message content and/ormetadata, and is actuatable to initiate a view operation on thecommunication event; user interface elements 616 and 618 are the twoadditional actions selected to be represented when the unified eventcommunication view executes in the second mode, which in this case are“flag” and “delete”.

In response to the actuation of the “delete” user interface element 618(the element is again demarcated by an ellipse representing a possibletouch area if a touch input is employed), the communication eventlisting 610 is updated in view 600 b to listing 620. Instead ofimmediately removing the listing 610 from the communication event listview 600 b or interrupting the user's operation of the device 100 byprompting for the user to confirm deletion of the listing 610, as istypical in response to a delete command, the listing 620 is preserved inthe view 600 b with a form of placeholder.

In this example, both the content and actuatable user interface elementsof the communication event listing 620 are altered to provide a visualcue to the user that an instruction had been received to alter thestatus of the communication event represented by the listing 620, and toprovide further action options. Originally presented action userinterface elements 612, 614 have been replaced by a single placeholderelement 622, which in this example bears the notation “Message removed”.Action user interface element 616 has been removed from the view 600 b.The user interface element 624 in FIG. 6B is a blank area; within theactual document structure of the view 600 b this may still be a discretedisplay element, even though it is not actuatable. Action user interfaceelement 618, which represented the “delete” action, has been replacedwith an “undo” action user interface element 626 to permit the user toreverse the “delete” instruction. Just like the originally presentedaction user interface elements 616, 618, the “undo” action userinterface element 626 is maintained inline with the communication eventlisting so that it does not obscure other displayed content.

Thus, the altered communication event listing 620 is maintained in theview 600 b, providing the user with an opportunity to reverse thedeletion instruction, until a trigger committing the delete action isdetected. The trigger may be actuation of a user interface elementcorresponding to a different communication event, or an instruction tothe unified event manager 260 to exit the second mode and return to thefirst mode. Examples of triggering actions are illustrated in the view600 c of FIG. 6C: actuation of a toggle user interface element 640 or446 to change a state or attribute of another communication event;actuation of a principal user interface element 645 of anothercommunication event in order to invoke a view operation; or actuation ofthe mode toggling user interface element 420 (or other input command).However, a scroll or pan command to cycle displayed content onscreen toenable the user to view communication event listings that are part ofthe unified communication event view but are currently in an overflowregion not currently displayed on the screen, does not constitute atrigger in this implementation.

Turning to FIG. 6D, once the “delete” action is committed in response tothe detected trigger, the communication event listing 620 is removedaltogether from the view 600 d, and the communication event is deletedfrom its corresponding data store 210. In a manner known in the art inthe implementation of inbox views, the subsequent communication eventlisting 630 is then moved up into the position of the removedcommunication event listing 620. Alternatively, if the “undo” userinterface element 626 is actuated, the “deleted” status applied to thecommunication event is removed, and the communication event listing 620is restored to its original state 610, as shown in FIG. 6A. No changewould be made to the communication event as stored in its respectivedata store 210, since the communication event is not to be deleted.

A “file” action, which causes the communication event to be filed in aparticular virtual folder, or have a category or user-defined attributeassigned to it for organizational purposes, may be implemented in thesecond mode view 400 in a similar manner as the “delete” action. Forexample, the first time a “file” user interface element is invoked, theuser may be prompted to input a destination folder, category, etc. forthe communication event. Once input, the communication event listing isupdated to remove the “file” action user interface element, and replaceit with an “undo” user interface element, a “move” user interfaceelement, or both. The principal user interface element for thecommunication event may be altered to indicate to the user that aninstruction to “file” the event had been received. If “undo” isselected, the communication event listing is restored to its previousappearance, and the communication event is not filed. If “move” isselected, then the user is prompted to input a different destination forfiling the communication event. When a trigger event is detected, thechange to the storage location or folder for the communication event iscommitted, for example by updating the corresponding data store 210 toadd a value assigning the destination as a label or category. Once“filed”, the communication event listing may be removed from the view400 altogether, as in the case of a deletion. The “file” action isillustrated in connection with FIGS. 17D and 17E, discussed below.

The foregoing examples of setting a flag and changing the communicationevent status between read and unread may be considered to be togglingactions, since the user may toggle the flag and read/unread status ofthe communication event at will. While the option to “delete”, “file”,and “undo” the deletion or filing of a communication event effectivelyconstitute a toggling option, as explained above in the implementationillustrated in FIGS. 6A to 6D, the availability of the “undo” option istime-limited since the “delete” or “file” operation is committed once atrigger is detected.

The unified communication event views in FIGS. 4 to 6D have beenillustrated in a “conversation” or “threaded” view, in whichcommunication events determined to belong to a common conversation,thread, or other grouping (whether based on sender identity, subjectline, thread identifier, etc.) are represented by a single communicationevent listing, such as listing 340/440. It will be understood by thoseskilled in the art that the examples described herein can equally applyto views that do not use a conversation view, with suitablemodification. For instance, referring back to FIGS. 4, 5A, and 5B,toggling of the actions represented by the action user interfaceelements 442, 442′, 446, and 446′ may apply to all communication eventsin the grouping represented by that communication event listing (or, inone variation, only to the last event in the grouping). Thus, everycommunication event in the grouping will be marked read/unread, filed,deleted, etc. together. If the communication event listing representsonly a single communication event and not a grouping, then the toggledaction is applied only to that communication event.

Particular to a “conversation” view, however, is the display of afurther conversation view by the unified event manager 260 in responseto a command to view a particular communication event listing. Turningto FIG. 7A, an initial unified communication event view 700 a is shown,similar to view 400 of FIG. 4. When a main user interface element for acommunication event listing representing a conversation or grouping ofcommunication events is selected, such as user interface element 444,the unified event manager 260 retrieves further data pertaining to theconversation or grouping and presents a further view 700 b listing thecommunication events belonging to that conversation or grouping, asshown in FIG. 700 b.

It may be noted that in the example of FIG. 7A, view 700 a comprised theunified communication event view in the second mode. In response to theactuation of the user interface element 444 to view details of thatparticular communication event listing, the unified event manager 260caused the view to exit the second mode, and return to the initial modein FIG. 7B, so view 700 b comprises a plurality of communication eventlistings 730 in a similar manner to the view 300 of FIG. 3. The secondmode may again be invoked in response to the command to invoke thatmode, for instance actuation of the user interface element 420, as shownin FIG. 7C. As a result, the unified event manager 260 alters the viewto that of 700 c, to include an array of additional action userinterface elements 750 corresponding to each of the communication eventsdisplayed in the view 700 c. In an alternative implementation, thesecond mode may be preserved when the view transitions to 700 b, so itis not necessary for the user to re-invoke the second mode when the view700 c is displayed.

While each custodian application 220 corresponding to a givencommunication message type may define the available additional actionsto be displayed in arrays 450 and 750, some configuration of the userinterface elements included in the array may be carried out by the user.FIG. 8 illustrates an example view 800 for selecting actions for each ofthe first and second action user interface elements of the array fromavailable sets 810 and 820, respectively. The eligible actions that areincluded in sets 810 and 820 may be defined by the custodian application220 and/or the unified event manager 260.

From the foregoing description, it will be appreciated that theinvocation of the unified communication event listing view in the secondmode (e.g. view 400) permits the user to initiate actions on a pluralityof communication events within a single view, even when thosecommunication events are of different types or associated with differentuser accounts, potentially using the same principal input action (e.g. atouch, in the case of a touchscreen, or a single click, in the case of acomputing device receiving pointing device input). The second mode andarray 450 or 750 are to be distinguished from a context menu, which istypically invoked by a secondary input action (e.g., a long press, inthe case of a touchscreen, or a right-click, in the case of a computingdevice receiving pointing device input). This distinction is illustratedin FIGS. 9A and 9B, which depict the invocation of a context menu.

Context menus may be invoked for the inbox or unified communicationevent view as a whole; in relation to a specified user account; or inrelation to a particular event type. The construction and use of contextmenus is generally understood by those skilled in the art. FIG. 9A showsa unified communication event view 900, in which an initial view of acontext menu 950 has been invoked. The view 900 here is in the secondmode, and is therefore similar to the view 400 shown in FIG. 4. Thecontext menu 950 in this example is displayed in response to a contextmenu command, which here is invoked by a long press on a selectedcommunication event listing 930. Since the context menu command wasinvoked in connection with a communication event listing, the contextmenu 950 is specific to the selected communication event type.Accordingly, the context menu includes user interface elements that canbe actuated to invoke communication event-specific actions, such asmarking the event read or unread 952, or replying to the event 954.Thus, the context menu can include user interface elements for actionsthat were also included in the second mode unified view 900.

The context menu 950 overlays the view 900; therefore, only the regionof the context menu 950 is active and capable of receiving user input.Any user interface elements in the underlying view 900 are notactuatable while the context menu 950 is displayed. In someimplementations, the context menu 950 may be extended to a wider view950′, as can be seen in FIG. 9B. This wider view 950′ may includeadditional information regarding the displayed user interface elements,and optionally more user interface elements for invoking furtheractions. The context menu 950, 950′ is thus a different logical andfunctional entity from the array 450, 750 or unified communication eventview discussed above. Further, the context menu 950, 950′, being invokedin the context of a single selected communication event, does notprovide action user interface elements that can operate on anycommunication event besides the currently selected event.

The arrays 450 and 750 include sets of up to two action user interfaceelements for each communication event listing. In alternate embodiments,only one action user interface element, three action user interfaceelements, or more action user interface elements, may be included. FIG.10 illustrates a further example of a unified communication event view1000 in the second mode, including an array 1050 of up to threedifferent action user interface elements to be displayed in associationwith each listed communication event. Thus, a single communication eventlisting 1040 can include up to five separate user interface elements forinvoking different actions. In the example of FIG. 10, the first listing1040, which represents an email conversation communication event,includes a first toggle user interface element 442 for toggling thestatus of the conversation (i.e., all messages within the conversation)as either read or unread, as described above; a second principal userinterface element 444, as described above, for invoking a view operationfor the communication event; and three further action user interfaceelements 446, 447, and 448. User interface elements 446 and 448 weredescribed above; element 447 is a third element for still a furtheraction, which here is a “file” action. Table 2 extends the possibleaction assignments set out in Table 1 to include a third action:

TABLE 2 Example assignment of three actions according to communicationevent type. Type Action 1 Action 2 Action 3 Email message thread FlagFile Delete Single email Flag File Delete Draft message (any None File(or Edit, or Delete type) None) Meeting invitation Tentative AcceptDecline Device event (e.g. None None Delete device status) SMS messageReply (text) Reply (call) Delete (end chat) IM message None Reply Delete(end chat) PIN message None None Delete Social message None Share (orNone) Delete Phone event (e.g. None (or add to Send reply SMS (or Deletemissed call) Contacts) None) Other (default) None None Delete

In some cases, the communication event can be associated with an actionthat invokes communication, as in the case of a reply (either by textmessage, e.g. SMS, or by a telephone call) or sharing a socialnetworking message, and/or invokes a further application executing onthe device, such as the “add to Contacts” action; actuation of such anaction may invoke the launch of an address book application on theelectronic device 100.

Of course, the various actions listed above in Tables 1 and 2 need notbe presented in the order suggested in these tables. Moreover, actionssuggested in a table for use in association with one type ofcommunication event may also be associated with other communicationevent types even if not expressly declared in one of the above tables.

As noted above, in some instances the selection of a particular actionuser interface element in the array 450, 750, or 1050 results in achange to the displayed user interface elements to permit the user toselect an “undo” or other action. Table 3 sets out some possible actionsthat may replace an initially displayed user interface element:

TABLE 3 Replacement actions. Originally Displayed Action ReplacementAction Comment Flag (set) Flag (remove) Toggle (reversal of actiontaken) Flag (remove) Flag (set) Toggle File Undo/Move to Either toggleor modify different location action taken Accept/Decline (forFile/Delete Actions are completely meeting invitation) replaced

From the foregoing, it can be seen that configuring the unified eventmanager 260 in this manner to selectively display the unifiedcommunication event view in either the first mode or second modeimproves efficiency in the processing and management of communicationevents via the primary user interface mechanism on a handheld mobiledevice, namely, the display screen or touchscreen. Returning briefly tothe particular example of FIG. 4, it can be seen that it istheoretically possible for four different operations to be carried outon the first four communication events displayed in the view 400:clearing a flag, deleting the communication event, setting a flag, andaccepting or declining a meeting invitation. All of these operations canbe invoked within a single session of the unified communication eventlist view 400 in the second mode, without requiring invocation of acontext menu. Further, the sets of operations can be different forcommunication events of different types or associated with differentuser accounts. In a touchscreen implementation, these operations can beaccomplished by as few as five or six touches (i.e., n+1 or n+2touches): one touch to invoke the second mode; one touch for each actionuser interface element of the array 450 to be actuated; and depending onthe order in which the action user interface elements are actuated, onefinal triggering touch to commit the last action invoked in the secondmode. For example, if the final action taken is to set or clear a flag,there is no need for a further triggering event to commit the finalaction; but if the final action is deletion, then a further triggeringevent is required to commit the communication event deletion. It shouldbe noted that depending on how the handling of meeting invitations bythe unified event manager 260 is configured, additional touches or userinput may be required to accept or decline the invitation. By contrast,carrying out the same operations in the view 300 of FIG. 3 requires atleast 2n touches, two per communication event. This solution thereforereduces the amount of resource time spent processing user input, andalso reduces the amount of time the user must spend interacting with theunified view in order to process these messages. An improved interfacewith communication events that facilitates message processing by theuser may also assist in improving device resource management, sinceincoming communication events may be processed more promptly, andunneeded events deleted more promptly from their respective data stores210.

FIG. 11 is a flowchart illustrating a general method 1100 forimplementing the unified communication event view described above on anelectronic device 100. At 1110, the initial unified view (e.g., view 300of FIG. 3A) is displayed in the first mode. At 1120, user input isdetected at the electronic device 100. At 1130, the input is identifiedas one of three general types of input. If the input is identified as acommand to invoke the second mode, then at 1140 the unified eventmanager 260 retrieves the various additional actions that are associatedwith the different communication event types and/or accounts displayedin the unified view 300, and modifies the view for the second mode, e.g.view 400 of FIG. 4, including user interface elements corresponding tothe additional actions. The method 1100 then returns to 1120, where thedevice 100 awaits further input. A determination is made at 1180 whetherthe input that had been previously received is a command to exit thesecond mode, but this determination may be bypassed when unified eventmanager 260 is already operating in the first mode.

If the input is determined at 1130 to be a selection of a second modeaction by actuation of a user interface element, which can occur onlywhen the unified event manager 260 is operating in the second mode andthe appropriate unified communication event view (e.g., 400) isdisplayed, then at 1150 the unified event manager 260 determines whetherthe action associated with the user interface element is a“placeholder”-type action such as a “delete” action, where an additionaltriggering event is required before the action is committed. If so, datapertaining to the operation to be carried out, such as an identifier ofthe target communication event, an identifier of the action to be taken,and optionally an identifier for the custodian application 220, arestored at 1160. Next, the view 400 is updated at 1165 to reflect thecurrently available actions by changing the displayed user interfaceelements, as necessary. As summarized in Table 3 above, for example,once a “delete” action is selected, the “delete” action user interfaceelement in the view 400 is replaced with an “undo” action user interfaceelement. The method 1100 then returns to 1120 to await further input.

If the second mode action that was invoked is not a placeholder action,or if the input is identified at 1130 as a triggering event, explainedabove, then at 1170 the unified event manager 260 commits the selectedoperations that had been stored previously. Further, any operations thatare invoked by the triggering event itself—for example, a selection of aprincipal user interface element to view a message, to select aparticular account to view, etc.—are carried out as well, and thedisplayed view is updated at 1175 to reflect the currently availableactions. At 1180, it is determined whether the second mode is to beexited and the unified event manager 260 is to return to the first mode.If this is the case, the method 1100 returns to 1110, and the view fromthe first mode is displayed. If not, the method returns to 1120 andawaits further input.

FIG. 12 illustrates the interaction between select components of theelectronic device 100, including three example data stores 210 and theircorresponding custodian applications 220, the invocation manager 250(which is optional), and the unified event manager 260. Newcommunication events 1200 a, 1200 b, and 1200 c may be obtained at anytime by an application 220 and stored in the appropriate data store 210.The particular mechanism by which the data stores 210 obtain the eventsis not pertinent, but if the corresponding application 220 did notcreate the communication event in the data store 210, then theapplication is notified. The application 220 then notifies the unifiedevent manager 260 by event notification messages 1205 a, 1205 b, and1205 c that new communication events are available. The notificationsmay be implemented as described above with respect to FIG. 2, with orwithout the use of a merged index 230.

While the unified event manager 260 operates in the second mode, itreceives commands for actions associated with various communicationevents as described above. A first command is received at 1210. Ifnecessary, a triggering event is awaited, and then at 1215 the unifiedevent manager 260 passes an invocation request to the invocation manager250 to implement the relevant operation on the communication event. Theinvocation request may contain, at a minimum, an identifier for thetarget communication event, data identifying the action to be taken withany required parameters (e.g., setting a flag, deletion, etc.), andoptionally an identifier for the application. The structure of theinvocation request may be any suitable structure. As one example, toensure relative uniqueness of the identifiers and to identify ownershipof an action by a particular application, the identifiers may beformatted in a reverse DNS format (e.g., com.acme.appname to identify atarget application, and com.acme.action.FLAG to define a “flag” action).The identifier for the target communication event may be in the form ofa memory address, unique identifier assigned by the application 220 ordata store 210, or a uniform resource indicator (URI). The communicationevent identifier would have been provided to the unified event manager260 initially in the event notification 1205 a, b, or c. If otherparameters are included in the invocation request, they are included inwhatever format is required by the invocation manager 250.

The invocation manager 250, having received the request 1215, thenidentifies the target application 220 and sends an action request 1220to the application 220 with data obtained from the invocation request.The application 220 executes the request, resulting in an update to thedata store 1225 to store the changed attribute or status, or to move ordelete the communication event, as the case may be. In thisimplementation, no confirmation is sent by the application 220 to theinvocation manager 250, or from the invocation manager 250 to theunified event manager 260; instead, this implementation relies on theapplication 220 updating the unified event manager 260 regarding achange to the application's data store 210, as it would during normaloperation. In other implementations, an acknowledgement or confirmationmessage may be sent between the application 220 and the invocationmanager 250, or the invocation manager 250 and the unified event manager260.

FIG. 12 also illustrates a variant in which, after receipt of a secondmode action command 1230, the unified event manager 260 sends a request1235 directly to the custodian application 220, in a manner similar tothat described above. In this case, the unified event manager 260 mustbe provided with the target application identifier. This may be includedin the event notification 1205 a, b, or c, along with the communicationevent's own identifier. The remainder of the process is similar; theapplication updates the communication event 1240 in the data store 1210,and then provides an event update notification 1250 to the unified eventmanager 260.

Some actions require the transmission of a message from the electronicdevice 100, as in the case of accepting or declining a meetinginvitation, or sending a reply message. FIGS. 13A to 13C illustrate thehandling of calendar events (meeting invitations) in one implementation.In FIG. 13A, a unified communication event view 1300 a in the secondmode is shown; this is similar to the view 400 of FIG. 4. Communicationevent listing 1310 includes two action user interface elements in thismode: an accept user interface element 1312, and a decline userinterface element 1314. In some embodiments, actuation of either one ofthese elements 1312, 1314 results in automatic transmission of aresponse by the appropriate message transport (e.g., email, IM, SMS)without further user intervention. In others, the user is presented witha dialog box to either confirm or add further message content. FIG. 13Bshows a possible dialog box 1330 resulting from actuation of the acceptuser interface element 1312, which permits the user to add optionalmessage content, and to choose to either send an accept message(notification), or accept the invitation without sending an acceptmessage. This dialog box 1330 may be generated by either the unifiedevent manager 260 itself, or by a calendar application or applicationcorresponding to the calendar event on request by the unified eventmanager 260.

Once the meeting invitation is accepted and the dialog box 1330 isdismissed, the view is updated, as shown in FIG. 13C. View 1300 c nowprovides different action user interface elements in place of theprevious accept and decline user interface elements. In FIG. 13C, theyhave been replaced with a toggling flag user interface element 1313, anda delete user interface element 1315.

Other cases where transmission of a message can be effected from theunified communication event view is illustrated in FIGS. 14A to 14I.These examples illustrate possible message transmissions in response toIM, social networking, and SMS messages. FIG. 14A illustrates a firstview 1400 a, again in the second mode, showing a portion of the unifiedcommunication event view, including an IM communication event listing1410 a. The view 1400 a includes a variety of other communication eventtypes, including email, SMS, and a social networking message. One of theaction user interface elements associated with the IM communicationevent listing 1410 a is a “reply” (or “compose”) action 1412. In theunified communication event view 1400 a, only select information aboutthe IM communication event is visible, such as the correspondent or“buddy” identity, the datestamp, and a preview of the last IM messagesent or received. The preview may not include the entire message.

In response to actuation of the “reply” action user interface element1412, a reply dialog panel is displayed. In FIG. 14B, this is displayedas an overlay 1420 over the view 1400 a. The overlay 1420 in thisexample includes the complete previous IM message 1422, an input fieldfor entering message content 1424, a “send” user interface element 1426for initiating transmission of the reply message with any input messagecontent, and a “close” or “cancel” user interface element 1428 that canbe actuated to dismiss the overlay 1420. Alternatively, the overlay maybe dismissed by a detected touch on the portion of the screen notoccupied by the overlay. The overlay may be generated by the unifiedevent manager 260, or alternatively it may be generated by theapplication associated with the communication event in response to aninvocation request received directly from the unified event manager 260or the invocation manager 250. Either way, additional communicationevent data may have been retrieved from the associated data store 210 inorder to present the complete message in the overlay 1420. As can beseen from the drawings, while the overlay is displayed and receivinginput, at least part of the underlying unified communication event view1400 a is still at least partially visible. The overlay 1420 may extendover the entire display screen, but the data entry portion of theoverlay 1420 (e.g., elements 1422-1428) only occupy a portion of thescreen. The rest of the overlay 1420 may be defined with a level oftransparency so that the listings in the view 1400 a remain legible,although not currently capable of receiving focus or being actuated. Inother implementations, the overlay 1420 may completely obscure theunderlying view 1400 a.

FIG. 14C illustrates the overlay 1420 over the view 1400 a after sometext has been input in the input field 1424. In some embodiments,additional features may be made available for message composition, suchas rich text formatting, emoticons, stickers, options for attachingmedia files or calendar invitations, and so on. In response to actuationof the “send” user interface element 1426, the relevant applicationcreates the message and initiates transmission from the device 100.Since a new message has been created, it is stored in the associateddata store 210, and a notification is ultimately provided to the unifiedevent manager 260 of the new message. Accordingly, the unified eventmanager 260 updates the view 1400 d, as can be seen in FIG. 14D. Thecommunication event listing 1410 a has now been replaced with listing1410 b, which has been moved to the top of the communication eventlistings in 1400 d since the listings are ordered in reversechronological order (as is generally done in the art), and thisnewly-transmitted message has the most recent time stamp. In someimplementations, sent messages are omitted from the unified view; inthat case, the position of the communication event listing may notchange in the view. In the example of FIG. 14D, the unified eventmanager 260 has also automatically exited the second mode once themessage was transmitted. However, it may be desirable to maintain theunified event manager 260 in the second mode even after the message hasbeen transmitted, as is the case in the next example.

FIG. 14E again depicts the original view 1400 a from FIG. 14A. In thisfigure, a social networking message or post 1430 is indicated. Thiscommunication event listing includes two action user interface elements,one of which is a “share” action 1432. In this example, it is presumedthat the social networking platform does not support direct messaging,and that users “share” posts by posting them to their own accounts,optionally with a suitable reference back to the original user whoposted the message.

In response to actuation of the user interface element 1432, an overlay1440 is generated and displayed over top of the view 1400 a, as shown inFIG. 14F. As discussed above, the overlay 1440 may be generated by theunified event manager 260, or it may be generated by the application 220corresponding to the communication event type. The overlay 1440 againincludes the complete social network message 1442, an input field forentering message content 1444, a “share” user interface element 1446 forinitiating transmission of the reply message with any input messagecontent, and an optional “close” or “cancel” user interface element1448. Once content is input in the input field 1444 and the “share”action is invoked, the corresponding application 220 generates a post ormessage which in this case is addressed to the user's own account, andthe post or message is transmitted from the electronic device 100 to thesocial networking service. In this particular example, it is presumedthat a user will not receive notification of his own posts; therefore,there is no resultant change to the view 1400 a.

FIGS. 14G to 14I illustrate the third example of an SMS message sent inreply to a received message. View 1400 a is again shown in FIG. 14G, butin this figure an SMS communication event listing 1450 a is indicated.This communication event listing includes a “reply” or “compose” actionuser interface element 1452 in the second mode. When this element isactuated, once again an overlay 1460 is invoked and displayed over theview 1400 a, as shown in FIG. 14H. Again, the source of this overlay1460 may be the unified event manager 260, or the relevant application220. The overlay 1460 may include similar components as the exampleoverlay 1420; the most recent message displayed in full 1462, an inputfield for message content 1464, and a “send” user interface element1466. Once message content is input and the “send” command actuated, therelevant application 220 constructs and transmits the reply message;then, as can be seen in FIG. 14I, the view is updated, and communicationevent listing 1450 a is removed, and replaced by listing 1450 b in theposition of the most recent message on the device. In the example ofFIG. 14I, the final view 1400 i is not in the second mode anymore, asthe unified event manager 260 automatically transitioned to the firstmode; however, it may be desirable to maintain the second mode asmentioned above, to permit the user to quickly access similar replyactions for other messages.

In any of these examples, the overlay 1420, 1440, 1460 may be configuredto permit the user to select additional addressees of the message, ifdirect addressing is supported by the communication type.

Conventionally, SMS and IM messaging applications, as well as thosedirected to email and other formats, do not permit responses to be inputfrom an inbox screen without first displaying the recent messages in thehistory of the SMS or IM conversation. Thus, in a conventionaltouchscreen device, it takes an additional user action to arrive at a“send” button or other user interface element for sending a replymessage, as the user must first load the SMS or IM application screen toview previous messages. In these examples, however, the user is able toquickly initiate a reply to any supported message within the sameunified communication event view without having to first invoke a viewof the message or conversation, even if the conversation has aged and isnot recently received. Furthermore, the user is able to respond tomessages of multiple types in serial from the same unified communicationevent view.

FIG. 15 is a flowchart illustrating a general method 1500 implementableby the electronic device 100 to carry out the quick reply functions andcalendar event handling functions described with relation to FIGS. 13Ato 14I. At 1510, the initial unified view (e.g., view 300 of FIG. 3A) isdisplayed in the first mode. At 1515, user input is detected at theelectronic device 100. At 1520, the input is identified as one of threegeneral types of input. If the input is identified as a command toinvoke the second mode, then at 1525 the unified event manager 260retrieves the various additional actions that are associated with thedifferent communication event types and/or accounts displayed in theunified view 300, and modifies the view for the second mode, e.g. view400 of FIG. 4, including user interface elements corresponding to theadditional actions. The method 1500 then returns to 1515, where thedevice 100 awaits further input. A determination is made at 1585 whetherthe input that had been previously received is a command to exit thesecond mode, but this determination may be bypassed when unified eventmanager 260 is already operating in the first mode.

If the input is determined at 1520 to be a selection of a second modeaction by actuation of a user interface element, which can occur onlywhen the unified event manager 260 is operating in the second mode andthe appropriate unified communication event view (e.g., 400) isdisplayed, then at 1530 the unified event manager 260 determines whetherthe action associated with the user interface element is a“placeholder”-type action such as a “delete” action, where an additionaltriggering event is required before the action is committed. If so, datapertaining to the operation to be carried out, such as an identifier ofthe target communication event, an identifier of the action to be taken,and optionally an identifier for the custodian application 220, arestored at 1535. Next, the view 400 is updated at 1540 to reflect thecurrently available actions by changing the displayed user interfaceelements, as necessary. As summarized in Table 3 above, for example,once a “delete” action is selected, the “delete” action user interfaceelement in the view 400 is replaced with an “undo” action user interfaceelement. The method 1500 then returns to 1515 to await further input.

If the second mode action that was invoked by the input is not aplaceholder action, nor a reply or accept/decline action, then at 1560the unified event manager 260 commits any selected operations that hadbeen stored previously. Further, any operations that are invoked by thissecond mode action are also carried out at 1560, and the displayed viewis updated at 1565 before returning to 1585 and 1515 to await furtherinput. If the second mode action is indeed a reply or an accept/declineaction, then the overlay 1420, 1440, 1460 as applicable is displayed andinput content is received at 1570. The target application that will sendthe message is invoked at 1575, and the message is transmitted at 1580,and the unified communication event view is updated accordingly. Note,however, that if the overlay is generated and managed by the applicationrather than the unified event manager 260, then the target applicationwill be invoked prior to receiving input content. The method thenreturns to 1585 and 1515.

If the input identified at 1520 is a triggering event and is not a replyor accept/decline action, then the method again returns to 1560 and 1565before returning to 1585 and 1515.

At 1585, it is determined whether the second mode is to be exited andthe unified event manager 260 is to return to the first mode. If this isthe case, the method 1500 returns to 1510, and the view from the firstmode is displayed. If not, the method returns to 1515 and awaits furtherinput.

FIG. 16 illustrates interaction between the data store 210, application220, invocation manager 250, and unified event manager 260 inimplementing quick replies and accept/decline actions while the unifiedevent manager 260 is operating in the second mode. This interactiondiagram describes two possible implementations: one in which the unifiedevent manager 260 collects the necessary data (e.g., message contentinput, previous message content, etc.) and generates the overlay ordialog box for inputting the reply message, and another in which theunified event manager 260 calls the application 220 to carry out thesetasks.

Starting with the first example implementation, the unified eventmanager 260 receives a command to initiate a reply (or anaccept/decline) action, as well as input content for generating thereply, at 1610. The unified event manager 260 sends an invocationrequest 1615 to the invocation manager 250. The invocation request 1615and its data may take a form as described above in relation to FIG. 12,and will include identifiers for the communication event to which areply is to be generated, the target application, the action to betaken, and the message content. The unified event manager 260 must alsoencode the data in a form acceptable to the invocation manager 250and/or the target application 220, or at least specify in the invocationrequest the encoding or format used for the data that is submitted. Inone implementation, the unified event manager 260 may temporarily storethe input message content in memory, and may simply include a URI orother address for the stored input message content in the invocationrequest.

The invocation manager 250 then constructs and sends an action request1620 to the application 220 that owns the data store 210 associated withthe communication event type, using the data received in the invocationrequest. Alternatively, the invocation manager 250 may be omitted fromthe device, in which case the unified event manager 260 must generateand send an action request 1625 directly to the target application 220.

The application 220, in response to the action request 1620 or 1625,generates a new communication event based on the received data which isstored in the data store 210, and transmits the event from the device.The application 220 thereafter notifies the unified event manager 260 ofthe change to the data store 210 by message 1635. The unified eventmanager 260 can then update its view to reflect the sent message.

Alternatively, the reply data may be collected by the application 220.In the second example illustrated in FIG. 16, the unified event manager260 receives the reply command at 1650. However, instead of collectingdata for the reply, the unified event manager 260 instead transmits aninvocation request 1655 to the invocation manager 250. This requestwould include an identifier of the target communication event and thetarget application, as well as an identifier of the action to be taken.In this case, however, there is no occasion for the unified eventmanager 260 to format and transmit message content as part of theinvocation request.

The invocation manager 250 then sends an action request 1660 to therelevant application 220, as described above. Also as described above,in some implementations the invocation manager 250 is omitted, in whichcase an action request 1665 is constructed and sent directly by theunified event manager 260 to the application 220. Either way, if theapplication 220 is not already executing on the electronic device 100,the invocation manager 250 will cause the application 220 to launch.

The application 220, having received the action request 1660 or 1665,then generates a screen or partial screen comprising the necessary inputfields for receiving message content. This screen is pushed to the topof the display stack, overlaying the unified communication event view.The application 220 then receives the input content for the reply, andwith this data generates a new event 1675 and stores it in the datastore 210. The event is then transmitted form the device, and theapplication 220 notifies the unified event manager 260 of the change tothe data store with by message 1680. Finally, the unified event manager260 can update its view to reflect the sent message.

The unified communication event view may be further adapted toconveniently provide the user with access to additional actions for onlya particular communication event, such as the last-viewed communicationevent, even when the unified event manager 260 is operating in the firstmode. Turning to FIG. 17A, an initial, first mode view 1700 a is shown.In this view, one communication event listing, such as listing 1710, isselected by the user for viewing, for example by actuating the listing'smain user interface element to initiate the view operation. This initialstep may take place while the view 1700 a is in the second mode.

In response to the actuation, the communication event content andmetadata is retrieved from the appropriate communication event store210, and presented in a message view 1700 b, as can be seen in FIG. 17B.This view overlays or replaces the unified view 1700 a, and contains theretrieved message content and metadata 1720.

Once the user has finished with the message view 1700 b, the view may bedismissed from the display screen. The dismissal may be initiated by anysuitable predefined action, such as a keypress, sideways scroll, etc. Inthe example of FIG. 17C, it can be seen that the message view may bedismissed by a swipe gesture on the message view 1700 b, as indicated bythe arrow in FIG. 17C. Once the message 1720 has been viewed for atleast a predefined period of time, it is deemed “read”, and thisattribute of the message is toggled as necessary and the stored copy ofthe message is updated. Thus, in FIG. 17C, it can be seen that the icon1712′ associated with the message 1720 has been changed (as compared toicon 1712 in FIG. 17A) to reflect its new “read” status.

When the message view 1700 b has been dismissed, the unifiedcommunication event view 1700 d is redisplayed; however, in thisembodiment, the view 1700 d is not identical to the view 1700 a that wasinitially displayed, in that it includes further user interface elementsfor additional actions (in addition to the visual change to the icon inthe user interface element 1712). The single communication event listingthat was acted on in FIG. 17A-17B is now replaced with a multi-actioncommunication event listing 1730, as can be seen in FIG. 17D. Thiscommunication event listing 1730 resembles the communication eventlistings used in the unified view 400 in the second mode, with three ormore actuatable user interface elements. Similar to the communicationevent listing 440, in this example the listing 1730 includes a firsttoggle user interface element 1732, which may be used to toggle thestate of the communication event between a read and unread state; a mainuser interface element 1734, which as before may be actuated to initiatethe message view 1700 b; and at least one additional action userinterface element 1736, 1738. These additional action user interfaceelements may be allocated in the same manner as described above inrespect of the operation of the second mode for the unified view; inthis case, though, only the last-viewed communication event listing isaltered in this manner. The operation of the unified event manager 260and the user interface elements included in the listing 1730 is similarto that described above, with an additional triggering event, discussedbelow.

FIGS. 17E and 17F illustrate the operation of the “file” user interfaceelement 1736 that was described above. Once the element 1736 (shown inFIG. 17D) is actuated, the corresponding communication event may befiled automatically to the folder or category last designated by theuser. If this is the first time an event has been filed, then the usermay be prompted to select a destination folder or category. The view1700 d then updates to the view 1700 e of FIG. 17E, which has nowreplaced the previous communication event listing 1730 with aplaceholder listing 1740. The placeholder listing 1740 replaces the twooriginal additional “file” and “delete” user interface elements 1736,1738 to a “move” and “undo” element 1747, 1749 respectively. Actuationof the “move” user interface element may result in a dialog box beingpresented to permit the user to select an alternate destination for thecommunication event. Actuation of the “undo” element reverses the “file”command.

As discussed above, for those actions with a measure of permanence suchas deletion or filing/moving a file, the action is not committed beforegiving the user an opportunity to undo or abort the operation. In thecase of the second mode operation described above, the placeholderremains in the unified view until a triggering event is detected, suchas a termination of the second mode or actuation of another userinterface element in the unified view. In this implementation of theplaceholder for the last-viewed communication event, a further timeouttriggering event is added. A timeout period is set to be long enough topermit the user enough time to actuate one of the additional userinterface elements (e.g., 3500 milliseconds). The period may run fromthe time that the placeholder listing 1740 is initially displayed, orelse from the latest time that the user interacted with the listing1740. As can be seen in FIG. 17F, once the timeout period expireswithout any further action by the user, the file action is committed,the placeholder listing 1740 is removed from the view 1700 f, andcommunication event listing 1750, which was positioned below listing1710, 1730, and 1740, moves up in the unified view 1700 f.

FIGS. 17G and 17H illustrate an implementation of the “delete” action inthis last-viewed communication event embodiment. View 1700 g in FIG. 17Gis the same as view 1700 d in FIG. 17D; however, in this case, the“delete” action user interface element 1738 is actuated. The result, ascan be seen in FIG. 17H, is that the unified view 1700 h has beenaltered to replace the previous communication event listing 1730 with aplaceholder listing 1760, similar to the placeholder listing 1740. Thisplaceholder listing 1760 can include an “undo” user interface element,and again, if the timeout period expires without the user taking anyfurther action, the communication event deletion will be committed, andthe placeholder listing 1760 will be removed from the unified view.

Optionally, an interactive “toast” or notification is also displayed asthe result of a deletion or a file action. An example of a toast 1770 isillustrated in FIG. 17H. The toast overlays a portion of the unifiedview 1700 h, and includes an “undo” user interface element 1772 that maybe actuated to reverse the deletion. If a toast is used, then thetimeout period may run from the time the toast is initially displayed.

The modified, multi-action communication event listing that replaces theoriginal communication event listing for the last-viewed event need notbe limited to the “delete” and “file” actions. The additional actionuser interface elements may be associated with any set of one or moresuitable operations for the communication event type, such as a “flag”or “reply” action, in the manner described above.

FIG. 18 is a flowchart illustrating a method of operation 1800 for thedevice 100 in this embodiment. At 1805, the unified communication eventview is initially displayed, in either the first or second mode. At1810, in response to a user command, a single selected communicationevent is displayed. It should be noted that in the case where theunified view is configured to display messages collated in conversationsor other groupings, the single selected communication event may be agrouping of communication events. At 1815, the display of the selectedcommunication event is closed or dismissed, and the unified view isupdated by retrieving information about the actions applicable to thelast-viewed event, and modifying the view to include corresponding userinterface elements to the listing for the last-viewed event, at 1820.

At 1825, the unified event manager 260 waits for input. When input isreceived, at 1830, it is processed. Depending on the input, this mayresult in removal of the additional actions for the last-viewed event.Thus, at 1835, it is determined whether the input is a triggering event(e.g., termination of the current display mode, or actuation of anotheruser interface element for another event). If so, the actions that hadbeen selected or stored are committed at 1840, and the view is updatedat 1845 to remove the additional actions. If the action is determinednot to be a triggering event at 1835, then at 1850 it is determinedwhether a timeout has expired. If it has, then again, actions that hadbeen stored or selected are committed at 1840, and the view is updatedat 1845 to reflect the changes. As long as the timeout period has notexpired, however, the device 100 will await further input for the userinterface elements displayed for the last-viewed event.

The description above has referenced the retrieval of actions associatedwith specific communication event types or user accounts, and thegeneration of various views for data presentation and capture.Generally, when the unified event manager 260 is configured to generateall of these views, it must still obtain data from data stores 210 orapplications 220. Communication event content and metadata, used ingenerating the underlying unified views or overlays for displaying IM orSMS messages and receiving input text, may be obtained from the datastores 210, or from the merged index 230. Icons for use in the unifiedview that denote a communication event's MIME type (e.g., the icons usedin user interface elements 442 and 502 in FIGS. 4 and 5A) may be definedwithin the unified event manager 260. The unified event manager 260'sdata may also include icons or other graphic elements representingspecific actions, such as “reply”, “forward”, and “delete”. However,information about which communication event actions (e.g., “flag”)should be included or excluded from the second mode or the last-viewedinterface may need to be defined by the application, if not alreadydefined within the unified event manager 260 or if the application'scommunication event type is new to the unified event manager 260. Thismay occur on registration or installation of the application on thedevice 100. When the application is installed, it may be configured tonotify the invocation manager 250, unified event manager 260, and anyother required component, that is configured to receive action requests(from the invocation manager or unified event manager 260), and whataccount and communication event actions it supports, together withaddress information so that the unified event manager 260 can accuratelyconstruct invocation requests identifying the application's data andfunctions. The unified event manager 260 may store this data in its ownmemory space for later retrieval whenever a new unified view is to begenerated. Thus, when the unified event manager 260 constructs a view ineither the first or second mode, it may query the merged index 230 orconversation manager 240 (or individual data stores 210) forcommunication event data to be included in each listing; and based onthe identified communication event type, it may select the appropriateicons and actions for inclusion in user interface elements.

Not every action need necessarily be declared by an application as beinga supported action. For instance, deletion of messages may be consideredto be a universal action, in which case the unified event manager 260may be configured to include the “delete” action as a choice in allrenderings of the unified view.

The examples and embodiments are presented only by way of example andare not meant to limit the scope of the subject matter described herein.Variations of these examples and embodiments will be apparent to thosein the art, and are considered to be within the scope of the subjectmatter described herein. For example, some steps or acts in a process ormethod may be reordered or omitted, and features and aspects describedin respect of one embodiment may be incorporated into other describedembodiments. Further, while the foregoing examples were described andillustrated with reference to a handheld mobile device with atouchscreen interface, they may be implemented with suitablemodification on a computing device with a larger display screen orwithout a touchscreen interface. Where a touchscreen interface is notemployed, user input via the graphical user interface may be receivedfrom a pointing device and/or a keyboard. Further, while these exampleshave been illustrated in the context of a full-screen application, wherethe unified event listing view fills an entirety of the available screenspace allocated to application views, these examples may be modified foruse in an environment in which applications are displayed only in awindow or portion of the screen (i.e., not occupying the entire displayscreen).

The data employed by the systems, devices, and methods described hereinmay be stored in one or more data stores. The data stores can be of manydifferent types of storage devices and programming constructs, such asRAM, ROM, flash memory, programming data structures, programmingvariables, and so forth. Code adapted to provide the systems and methodsdescribed above may be provided on many different types ofcomputer-readable media including computer storage mechanisms (e.g.,CD-ROM, diskette, RAM, flash memory, computer's hard drive, etc.) thatcontain instructions for use in execution by one or more processors toperform the operations described herein. The media on which the code maybe provided is generally considered to be non-transitory or physical.

Computer components, software modules, engines, functions, and datastructures may be connected directly or indirectly to each other inorder to allow the flow of data needed for their operations. Variousfunctional units have been expressly or implicitly described as modules,engines, or similar terminology, in order to more particularly emphasizetheir independent implementation and operation. Such units may beimplemented in a unit of code, a subroutine unit, object (as in anobject-oriented paradigm), applet, script or other form of code. Suchfunctional units may also be implemented in hardware circuits comprisingcustom VLSI circuits or gate arrays; field-programmable gate arrays;programmable array logic; programmable logic devices; commerciallyavailable logic chips, transistors, and other such components.Functional units need not be physically located together, but may residein different locations, such as over several electronic devices ormemory devices, capable of being logically joined for execution.Functional units may also be implemented as combinations of software andhardware, such as a processor operating on a set of operational data orinstructions.

It should also be understood that steps and the order of the steps inthe processes and methods described herein may be altered, modifiedand/or augmented and still achieve the desired outcome. Throughout thespecification, terms such as “may” and “can” are used interchangeably.Use of any particular term should not be construed as limiting the scopeor requiring experimentation to implement the claimed subject matter orembodiments described herein. The language of this disclosure should notbe construed as a commitment to a “promise” to be fulfilled by theinvention(s). Any suggestion of substitutability of the electronicdevice for other implementation means should not be construed as anadmission that the invention(s) described herein are abstract, or thatthe electronic device or its components are non-essential to theinvention(s) described herein. Further, while this disclosure may havearticulated specific technical problems that are addressed by theinvention(s), the disclosure is not intended to be limiting in thisregard; the person of ordinary skill in the art will readily recognizeother technical problems addressed by the invention(s).

A portion of the disclosure of this patent document contains materialwhich is or may be subject to one or more of copyright, design, or tradedress protection, whether registered or unregistered. The rightsholderhas no objection to the reproduction of any such material as portrayedherein through facsimile reproduction of this disclosure as it appearsin the Patent and Trademark Office records, but otherwise reserves allrights whatsoever.

1. A method implemented by an electronic device, the method comprising:displaying, on a display screen, a view comprising a plurality ofcommunication event listings corresponding to a plurality ofcommunication events, the plurality of communication events comprising aplurality of communication event types or a plurality of accounts, theview being initially displayed in a first mode, each displayed listingof the view in the first mode comprising a user interface element forinitiating a first action operating on its corresponding communicationevent; in response to a command to invoke a second mode for the view,displaying the view in the second mode, each displayed listing of theview in the second mode comprising a user interface element forinitiating the first action and at least one additional user interfaceelement for initiating an additional action operating on thecorresponding communication event, different sets being provided forcommunication events of different communication event types or differentaccounts.
 2. The method of claim 1, wherein the second mode userinterface element for initiating the first action is a resized versionof the first mode user interface element.
 3. The method of claim 1,wherein the display screen comprises a touchscreen interface, and eachof the first mode user interface element for initiating the firstaction, second mode user interface element for initiating the firstaction, and the at least one additional user interface element are eachactuatable to initiate their corresponding action by a touch.
 4. Themethod of claim 1, wherein the view is generated by a unified eventapplication executing on the electronic device, and wherein the methodfurther comprises, while in the second mode: detecting actuation of oneof the additional user interface elements; and providing a request to adedicated application to execute the action on the communication eventcorresponding to the additional user interface element, the dedicatedapplication being associated with the communication event type oraccount of the communication event.
 5. The method of claim 1, whereinthe view is generated by a unified event application executing on theelectronic device, and wherein the method further comprises, while inthe second mode: detecting actuation of one of the additional userinterface elements; storing data for initiating the action associatedwith the actuated additional user interface element; and on detection ofa trigger, providing a request to a dedicated application to execute theaction on the communication event corresponding to the additional userinterface element, the dedicated application being associated with thecommunication event type or account of the communication event, thetrigger comprising either: actuation of another user interface elementin the view; or a command to invoke the first mode in place of thesecond mode.
 6. The method of claim 1, wherein each listing, in both thefirst mode and the second mode, comprises an icon element, the iconelement being included in the first mode user interface element butexcluded from the second mode user interface element; and wherein in thesecond mode, the icon element is comprised in a further user interfaceelement for initiating a further action operating on the correspondingcommunication event.
 7. The method of claim 7, wherein the furtheraction comprises a toggle between a read state and an unread state. 8.The method of claim 1, wherein the first action comprises a viewingoperation for the corresponding communication event.
 9. A non-transitoryelectronic device-readable medium bearing code which, when executed byone or more processors of an electronic device, causes the electronicdevice to implement the method of: displaying, on a display screen, aview comprising a plurality of communication event listingscorresponding to a plurality of communication events, the plurality ofcommunication events comprising a plurality of communication event typesor a plurality of accounts, the view being initially displayed in afirst mode, each displayed listing of the view in the first modecomprising a user interface element for initiating a first actionoperating on its corresponding communication event; in response to acommand to invoke a second mode for the view, displaying the view in thesecond mode, each displayed listing of the view in the second modecomprising a user interface element for initiating the first action andat least one additional user interface element for initiating anadditional action operating on the corresponding communication event,different sets being provided for communication events of differentcommunication event types or different accounts.
 10. The non-transitoryelectronic device-readable medium of claim 9, wherein the second modeuser interface element for initiating the first action is a resizedversion of the first mode user interface element.
 11. The non-transitoryelectronic device-readable medium of claim 9, wherein the display screencomprises a touchscreen interface, and each of the first mode userinterface element for initiating the first action, second mode userinterface element for initiating the first action, and the at least oneadditional user interface element are each actuatable to initiate theircorresponding action by a touch.
 12. The non-transitory electronicdevice-readable medium of claim 9, wherein the view is generated by aunified event application executing on the electronic device, andwherein the method further comprises, while in the second mode:detecting actuation of one of the additional user interface elements;and providing a request to a dedicated application to execute the actionon the communication event corresponding to the additional userinterface element, the dedicated application being associated with thecommunication event type or account of the communication event.
 13. Thenon-transitory electronic device-readable medium of claim 9, wherein theview is generated by a unified event application executing on theelectronic device, and wherein the method further comprises, while inthe second mode: detecting actuation of one of the additional userinterface elements; storing data for initiating the action associatedwith the actuated additional user interface element; and on detection ofa trigger, providing a request to a dedicated application to execute theaction on the communication event corresponding to the additional userinterface element, the dedicated application being associated with thecommunication event type or account of the communication event, thetrigger comprising either: actuation of another user interface elementin the view; or a command to invoke the first mode in place of thesecond mode.
 14. The non-transitory electronic device-readable medium ofclaim 9, wherein each listing, in both the first mode and the secondmode, comprises an icon element, the icon element being included in thefirst mode user interface element but excluded from the second mode userinterface element; and wherein in the second mode, the icon element iscomprised in a further user interface element for initiating a furtheraction operating on the corresponding communication event.
 15. Thenon-transitory electronic device-readable medium of claim 14, whereinthe further action comprises a toggle between a read state and an unreadstate.
 16. The non-transitory electronic device-readable medium of claim9, wherein the first action comprises a viewing operation for thecorresponding communication event.
 17. An electronic device, comprising:at least one communication subsystem; a display screen; and at least oneprocessor, the at least one processor being configured to: display, on adisplay screen, a view comprising a plurality of communication eventlistings corresponding to a plurality of communication events, theplurality of communication events comprising a plurality ofcommunication event types or a plurality of accounts, the view beinginitially displayed in a first mode, each displayed listing of the viewin the first mode comprising a user interface element for initiating afirst action operating on its corresponding communication event; inresponse to a command to invoke a second mode for the view, display theview in the second mode, each displayed listing of the view in thesecond mode comprising a user interface element for initiating the firstaction and at least one additional user interface element for initiatingan additional action operating on the corresponding communication event,different sets being provided for communication events of differentcommunication event types or different accounts.
 18. The electronicdevice of claim 17, wherein the view is generated by a unified eventapplication executing on the electronic device, and wherein the at leastone processor is further configured to, while in the second mode: detectactuation of one of the additional user interface elements; and providea request to a dedicated application to execute the action on thecommunication event corresponding to the additional user interfaceelement, the dedicated application being associated with thecommunication event type or account of the communication event.
 19. Theelectronic device of claim 17, wherein the view is generated by aunified event application executing on the electronic device, andwherein the at least one processor is further configured to, while inthe second mode: detect actuation of one of the additional userinterface elements; store data for initiating the action associated withthe actuated additional user interface element; and on detection of atrigger, provide a request to a dedicated application to execute theaction on the communication event corresponding to the additional userinterface element, the dedicated application being associated with thecommunication event type or account of the communication event, thetrigger comprising either: actuation of another user interface elementin the view; or a command to invoke the first mode in place of thesecond mode.
 20. The electronic device of claim 17, wherein eachlisting, in both the first mode and the second mode, comprises an iconelement, the icon element being included in the first mode userinterface element but excluded from the second mode user interfaceelement; and wherein in the second mode, the icon element is comprisedin a further user interface element for initiating a further actionoperating on the corresponding communication event.